Amplification of arbitrarily weak randomness 
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We demonstrate that amplification of arbitrarily weak randomness is possible using quantum 
resources. We present a randomness amplification protocol that involves Bell experiments. We 
report on two Bell inequalities which can amplify arbitrarily weak randomness and give detailed 
analysis for one of them. Our analysis includes finding a sufficient violation of Bell inequality as a 
function of the quality of randomness. It has a very important property that for any quality the 
required violation is strictly lower than possible to obtain using quantum resources. Among other 
things it means that the protocol takes a finite amount of time to amplify any randomness. 



I. INTRODUCTION 

The application of the laws of quantum mechanics al- 
lows to perform tasks impossible in classical information 
theory. The two most prominent examples are quan- 
tum computation and cryptography Recently, 
another area where quantum information theory makes 
new things possible has been found. It is the amplifica- 
tion of weak randomness [sj. This procedure not only 
has obvious practical applications but it also sheds light 
on fundamental issues such as completeness of quantum 
mechanics. However, so far the possibility of randomness 
amplification has been demonstrated only under very re- 
strictive conditions. To explain what they are we must 
first rigorously state the problem. 

We are given a source, which generates a sequence of 
bits X = xo,xi, ... parameterized by a single constant e. 
The bits may be correlated with each other and also with 
some external variables which we denote by A. However, 
there is a certain intrinsic randomness in each of the bits 
quantified by 

V. ^-e<P{x, = 0\xo,...,x,.uX)<^ + e. (1) 

If H]) holds we say that the sequence x (or the source) 
is e-free. e = corresponds to the case where the out- 
put of the source is perfectly random. When e = ^ we 
cannot say anything about the source and it can be even 
deterministic. The aim of randomness amplification is to 
use some postprocessing of the sequence x to generate 
another sequence y which is e'-free and e' < e. 

The source of randomness described above is usually 
called a Santha-Vazirani source after the authors of [J|, 
where they have proved that classical randomness am- 
plification is impossible. In their groundbreaking paper 
Colbeck and Renner [sS] showed that it is not true in the 
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quantum case. However, the protocol that they have pre- 
sented works only if the source of randomness is almost 
perfect to begin with. More precisely: if the source is e- 
free with e < 0.086. Very recently another paper on this 
issue appeared Q. There a protocol is presented which 
amplifies the randomness from any source with e < ^. 
Unfortunately, it only works in the noiseless case, which 
is impossible in practice and even if it was possible it 
would take infinitely long time to finish the procedure. 

Therefore, it remained an open question whether the 
amplification of arbitrarily weak randomness was possi- 
ble. In this paper we answer this question affirmatively. 
We do so by presenting a single amplification protocol 
which can be based on one of two different Bell inequal- 
ities. Both cases work for any e < ^ and can tolerate 
an amount of noise and experimental imperfections de- 
pending on e. Practically, it means that the time taken 
to amplify any randomness is finite. 



II. WHY RANDOMNESS AMPLIFICATION IS 
SO DIFFICULT? 

The main problem with randomness amplification lies 
in our almost complete ignorance about the inner work- 
ings of the source. It provides us with an infinite sequence 
of bits, yet all we know about it is expressed by a single 
number e. For every e there exists an infinite number of 
e-free sources and, while good randomness amplification 
procedures would work well for a vast majority of them, 
there will always be some that any given procedure fails 
to amplify. This is the essence of Santha-Vazirani proof. 

Another problem is that, since we are interested only 
in the quality of the sequences, we do not have access 
to any independent source of randomness. Or, in other 
words, we assume that all the sources of randomness that 
we have access to can be correlated and form one big 
Santha-Vazirani source. Therefore, without loss of gen- 
erality, any classical randomness amplification protocol 
can be reduced to applying a deterministic function to 
the output of the source to generate a new sequence: 

y = f{x). 
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How quantum mechanics can help? After all it is a the- 
ory built on intrinsic randomness. On the other hand, we 
cannot simply use a quantum random number generator 
because, under our assumptions, it is also only e-free. 
The solution lies in Bell inequalities. They have already 
been found useful in a related problem of device inde- 
pendent randomness expansion Q. In a nutshell, the 
idea is to use the sequence x to choose the settings of a 
Bell experiment and consider the outcomes your new se- 
quence y. Based on these sequences the violation of the 
Bell inequality is estimated and its value tells us if the 
amplification was successful or not. Let us elucidate. 

A. Biased nonlocal games 

One way of interpreting Bell inequalities is to think 
of them as nonlocal games. Let us take CHSH |71] as 
an example. If we want to treat it as a game then we 
will have a team of two players - Alice and Bob playing 
against a referee. The referee sends bits a and b to Alice 
and Bob respectively and the players, without communi- 
cation, announce their respective binary answers A and 
B. They win ii A (B B = ah. Usually, it is assumed 
that the probability distribution of the inputs is uniform 
p{a,b) = J. Under this condition the maximal winning 
probability for the parties having only classical resources 
is I while entanglement allows them to reach the success 

probability up to ^ ^1 + 

If we are to use e-free string of bits as a source of 
settings we cannot assume the uniform distribution of 
inputs anymore. Our game becomes a biased one with 
the success probability 

P,^J2pia^b)P{A®B = ab\a,b). (2) 

a,b 

The values of Pg for classical and quantum strategies for 
any distribution p(a,b) are greater than their counter- 
parts from the unbiased case. They have been found in 
Q. For every Bell inequality, the larger the observed 
value of Ps is the more random the local outcomes must 
be. One can use the hierarchy of semi-definite programs 
(SDP) from Q to efficiently find the lower bound on this 
randomness for any given distribution p{a,b). Unfortu- 
nately, we do not know this probability distribution. We 
cannot even estimate it because it may be different in 
each round of the experiment and the choice of the dis- 
tribution may be correlated with the state and measure- 
ment operators used by the player's devices via hidden 
variables A. The only thing that we know about p{a,b) 
is that both bits a and b come from an e-free source. But 
the impossibility of the direct application of SDP is not 
the last of the obstacles. 

Let us assume that our e-free source is well-behaved: 
for all i P{xi = 0|a;o, x^-i. A) = ^ + e. Even if Al- 
ice and Bob know this and adopt their states and mea- 
surements accordingly there is a value of e above which 



quantum and classical Ps are the same. One can use the 
results from [8j to find this value to be ecrit ~ ^ ~ \- 
And if a classical model exists that gives certain success 
probability in a nonlocal game there is also a determinis- 
tic one achieving it (lo| . Therefore, whenever the parties 
have a source with e above ecrit whatever success prob- 
ability they observe their outcomes can be determinis- 
tic. Fortunately, the value of ecrit depends on the Bell 
inequality chosen for the protocol. Therefore, our task 
is also to find Bell inequalities which are better for the 
purposes of randomness amplification than CHSH or the 
ones studied in H. 



B. Protocol 

Even if we find a good Bell inequality and a way to 
estimate the bias of the outcome by a function of success 
probability and initial bias e' < g{Ps,e) we cannot sim- 
ply take all the measurement outcomes and form y out of 
them. Because the state and measurement operators in 
each round can be different, so can be the success prob- 
ability. Therefore, in j-th round the actual value of the 
success probability will be P^ leading to the correspond- 
ing e^ while the parties can estimate only the average one 
Ps = jj ^jLi Ps ■ Even if the average success probability 
is high, it is possible that for a very subset of rounds 
are less or equal the classical maximum leading to e'^ = i 
and the output sequence being i-free - in other words, 
failure of the amplification procedure. 

Summing up, to amplify arbitrarily weak randomness 
we need three key ingredients: 

• a good Bell inequality; 

• a way to find the function g{Ps, e) for this Bell in- 
equality; 

• a protocol generating sequence y from the outcomes 
of the experiment. 

We now provide all of these. 

III. BELL INEQUALITIES 

To find a candidate for a Bell inequality to be used in 
randomness amplification protocol we first need to ask 
ourselves what properties are we looking for. To this end, 
let us consider one particular way of cheating. The mea- 
surement devices prepare an optimal classical strategy so 
they know in advance that for most of the messages from 
the referee they will produce a good answer but they also 
know that for some they will fail. The devices also know 
for which inputs they will fail. They can be tuned to the 
source of randomness in such a way that the inputs for 
the case when the devices fail are least likely to happen. 
We see that the weaker the randomness the higher the 
average success probability. If the randomness is very 
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weak the success probability is close to 1. If we want to 
amplify arbitrarily weak randoniness, to be certain that 
our device does not play this trick, the success proba- 
bility with a quantum strategy has to be even higher. 
Obviously, it cannot be greater than 1 so we have to look 
for nonlocal games for which it is equal to 1. 

Another property is more technical. The number of 
settings of the inequality for which this inequality reaches 
maximum success probability should be finite. Otherwise 
it would take an infinite amount of rounds of experiment 
to estimate the this probability This immediately rules 
out chained Bell inequalities [ll[ used in |3|. 

Finally, we would like our inequality to be as simple as 
possible. This property is not a strict requirement but 
can make a big difference in the analysis of the protocol. 

Taking this all into account we choose two Bell inequal- 
ities as our candidates: a variant of rnagic square game 
[l^ and tripartite Mermin inequality [isj . 

In the former Alice and Bob have three possible inputs 
a — 0,1,2 and b = 0,1,2 respectively. Each of them must 
return three bits denoted Aq,Ai and A2 for Alice and 
BqjBi and B2 for Bob. There is however an additional 
constraint that A2 ^ Aq ® Ai and B2 = Bq ® Bi ® 1 
which effectively reduces their outcomes to two bits. The 
parties win if Ah = Ba- Classical success probability for 
the unbiased version of this game is | and using quantum 
resources allows to reach 1. 

In the tripartite Mermin inequality Alice, Bob and 
Charlie each receive one bit input a, b and c respectively. 
There is a promise that a ® 6 © c = 0. Each of them 
also returns a single bit denoted A, B and C. They win 
if A © B © C = abc. In the unbiased version of this 
game the classical success probability is | and quantum 
mechanics again allows to reach 1. 



IV. BOUNDING THE RANDOMNESS 

As we have mentioned before, finding lower bounds on 
the quality of randomness generated by a playing a bi- 
ased nonlocal game is highly non-trivial. Therefore we 
will have to adopt different methods for different games 
and introduce some new concepts. The results we present 
in this paper are for tripartite Mermin inequality only. 
The result for magic square game are analogous but ex- 
hibit much worse behavior in the sense of tolerance to 
experimental imperfections as a function of e. 

Definition 1 - Extremal e-free source is a source in 
which 

Mi P(a;i = 0|xo,...,a;j_i,A) = i ±e. (3) 

Definition 2 - A source iS is a convex combination of 
sources Si if it works in the following way: When asked 
to provide a sequence of random bits it chooses one of the 
sources Si according to some predetermined probability 
distribution and then forwards the output of that source. 



Theorem 3 - Every e-free source is a convex combi- 
nation of extremal e-free sources. 

A proof of this theorem will be presented in forthcom- 
ing work fl3|. 

The immediate consequence of Theorem 3 is that in 
our analysis we can, without loss of generality, restrict 
ourselves to extremal e-free sources. In the case of tri- 
partite Mermin inequality we can use its symmetries to 
further simplify our task. 

Our aim is to find an upper bound on the following 
quantity 

Pmax = max P{X ^ i\a,b,c), (4) 

where X e {A, B,C} denotes the outcome of one of the 
parties. When we do then we know that the outcomes 
of the measurement are e'-free with e' < Pmax — \- In 
each round two bits a and b are taken from the e-free 
source and the third is automatically chosen to satisfy 
the promise a © 6 © c = 0. Because this inequality is 
invariant under the permutation of the parties and under 
two of the parties simultaneously relabeling their inputs 
we can, without loss of generality, restrict ourselves to 
considering only one source for every e. We take the one 
with P{b = 0|a) = P(a = 0) = i + e. 

Only now we are able to use the hierarchy of semi- 
definite programs from to find an upper bound on 
Pmax ■ We find that one can obtain good bounds on Pmax 
already with the first intermediate level of the hierarchy 
Qi+ABC- The first important result is that for Ps — 1 
we get Pmax = \ for any e < i. This means that if we 
have the maximal quantum violation we can fully amplify 
arbitrarily weak randomness. However certifying that Pg 
is exactly 1 would take an infinite amount of time so the 
main result of our analysis is that for any e < ^ there 
exists P5 < 1 such that e' = Pmax^\ < £• Our results are 
illustrated by two figures. First shows the upper bound 
on e' as a function of e and P,- The second shows the 
critical value of Ps such that for the success probabilities 
above it e' < e. 



V. FULL RANDOMNESS AMPLIFICATION 
PROTOCOL 

If, in every round of the experiment, the device would 
have the same probability of success we could simply take 
the outcomes of the experiment as our final sequence y 
and know its e' from P^ . Unfortunately we cannot assume 
that and have to apply some classical postprocessing. 

First we need to choose the confidence parameter S < 1 
and the target e'. Our aim is to use e-free source to 
get a single bit of e'-free randomness and certify it with 
probability of error less than 1 — S^. We will now show 
that it is possible for any triplet ^ < 1, e < i and e' > 0. 
Consider the following protocol: 

1. Run a nonlocal game N times using e-free source 
for the inputs. 
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FIG. 1: Maximal bias of the measurement outcome as a func- 
tion of the weakness of randomness and success probabihty 
of winning in a nonlocal game based on tripartite Mermin in- 
equality. This plot can be also understood as a critical value 
of the success probability required to take inputs from e-free 
source and get outcomes with bias less than e'. 
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FIG. 2: Critical success probability of winning probability in 
a nonlocal game based on tripartite Mermin inequality nec- 
essary for randomness amplification. It can be obtained from 
Fig.l by finding, for each e, minimum value of Ps such that 
e' < e. If, in each round of Bell experiment, the value of Ps 
would be the same this would also be a sufBcient condition. 



2. Calculate the estimate Pest of the average success 
probability Pavg- If it is below P with probability 
greater than 5 abort. 

3. Use the e-free source to choose one of the N rounds 
and take Alice's outcome to be the output bit of the 
whole protocol. This bit is e'-free with probability 
at least 6^. 

What remains to be done is to find the values of the 
parameters N and P and prove that the protocol indeed 
works as advertised. Though, the structure of the proto- 
col is the same for both games the parameters are calcu- 
lated in a slightly different way. 

In the case of tripartite Mermin inequality, because we 
were able to restrict our analysis to a particular kind of 



extremal source, the inputs of the nonlocal game are i.i.d. 
we can apply the result of 0] 



P [Pavg < Pest - x) < S, 



where 



S — exp 



V 



2 1 



(5) 



(6) 



and Pest is the estimated success probability. This gives 
us a requirement on N which we need to fulfill if we want 
to be able to estimate Pavg with good confidence. 

Now, using Fig. 1 we can find the critical value of Ps 
that corresponds to the target e' and given e and denote it 
Pc'. We want to have at most qN out of N rounds with 
randomness weaker than e' or, in other words, success 
probability below P^r. To estimate q let us write what 



Pavg is 



Pn 



3 \3eG j^G 



(7) 



where G is the subset of indexes j such that P| > P^' . It 
has (1 — q)N elements. Now we can write 

Pavg < ^ ((1 - l)N + qNP,,) = {l-q)+ qPe'. (8) 



Using (O we know that with probability at least 6 

Pest ~x<{l-q) + qP,, (9) 

q< — „ . (10) 



i-P.' 

We want the probability that in the last step of the pro- 
tocol the bit is chosen from the subset G to be larger 
than S 



1 



+ e 



- logq 



< 1-^. 



This will hold if 



Pest>P^l-(l-P.)2-'°'i-^^-'^ 



(11) 



(12) 



For any triplet S < 1, e < ^ and e' > x can be chosen 
arbitrarily small by taking N large enough. This enables 
us to always find P < 1. A critical value of P as a 
function of e is plotted in Fig 3. 



VI. CONCLUSIONS 

We have demonstrated that amplification of arbitrar- 
ily weak randomness is possible using quantum resources. 
We were able to derive the necessary bounds on the vio- 
lation of Bell inequalities as a function of the random- 
ness' quality. These bounds are below the maximum 
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FIG. 3: A sufficient condition for tfie violation of tripartite 
Mermin inequafity as a function of randomness quality. Al- 
though it is not clearly visible at the scale of the plot, the 
values of P are strictly lower than 1 for all < e < |. For 
this plot we have taken a: = and S = 0.99.j 



fact, it is known that neither of them can amphfy any 
kind of randomness when only no-signalhng is assumed. 
This follows straightforwardly from the results of for 
magic square game and from ^ for tripartite Mermin 
inequality. 

As our paper solves an open problem it also poses some 
new ones: Is amplification of arbitrarily weak random- 
ness possible with imperfect correlations for no-signalling 
theories? Are there any protocols more efficient than ours 
in the terms of ratio of random bits generated to random 
bits used? 

But the most important open problem is whether there 
are better amplification protocols using the same Bell 
inequalities. We conjecture that if, in the last step, the 
parties would choose and apply random hash function 
to the whole set of measurement outcomes rather than 
simply randomly choosing one of the bits then the critical 
success probabilities would be of a scale from Fig. 2 rather 
than Fig.3. 



achievable by quantum resources for arbitrarily weak ini- 
tial randomness. We have also presented a protocol that 
uses Bell inequalities for randomness amplification and 
calculated all of its parameters. 

We find of a particular interest the fact that the in- 
equalities we have demonstrated that perform well in ran- 
domness amplification only do so in quantum theory. In 
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